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Introduction 

Characteristically^ an experiment Involves a collection of treatment 
c^Mltlona Cl,e, treatacnt levels or treatment combinations), a 
collection of experlnental units, and an explicit plan for assigning 
Jreatnent conditions to units. For purposes of exposition, we can 
divide experiments Into those In which time plays an Important role and 
thO!ie In which It does not, Tlae tnay enter Into the experimental plan 
In several ways* For example, 1) at some point during a sequence of 
repeated neasurenentR of the experimental unit a treatment condition 
3ny be Introduced, as In trend analysis, 2) the experimental material 
rjiv he successively exposed to several pre-speclf led treatment conditions 
and measured after each, as when assessment of order or residual effects 
Is of Interest, 3) treatment conditions may be administered to experimental 
units over time In such a way that previous treatment conditions a'^d 
responses to them are used In determining the treatment conditions which 
follow. Note that In examples two and three treatment conditions are 
administered over time. But In the second example the exact treatment 
conditions are determined a priori , while In example three, they are 
determined during the experiment as a function of accumulating data. 
For convenience, we label the three examples as Instances of repeated 
measurement , serial , and sequential designs, respectively. 

The present research Is concerned with sequential experimentation- 
Experimental designs which are sequential In nature require that the 
experimenter consider both how the ensuing treatment conditions will be 
changed or adjusted and how the process will be discontinued, 
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l,e, a ''stopping rule". Sequential experiments can be differentiated 
' from one another by considering whether a formal or informal procedure 

is used when adjusting treatment conditions, whether the stopping rule 
is formal or informal, whether or not more than one factor Is used 
(i*e* multifactor experiment employing several different treatments)* 
whether the independent variable or dependent variable is continuous 
or discrete, and by considering the purpose of the procedures (e»g» 
locating maxima)* (For a general review and bibliography of recent 
work on experimental design, including the topics dealt with here, see 
Herzberg and Cox (1969) » For a current review of ^ the design of sequential 
experiments, see Chemoff (1975) » Wetherill (1975) provides a useful 
introduction to the subject of our paper)*) 

F.xamples of applications of sequential designs are not plentiful 
in the educational research literature* Meyer (1963) presents an 
application of response surface methodology* This methodology is seen 
as sequential in nature by Chemoff and by Wetherill* Response surface 
designs are factorial in nature, employing several quantitative indepen- 
dent variables* The dependent variable is often assumed continuous 
and a polynomial function of the independent variables* Purposes of 
these designs include locating maxima or estimating parameters of the 
polynomial* Decision rules which specify the "design points** to use 
in the next stage and when to stop the process tend to be informal* 

In contrast to response surface methodology are stochastic 
approximation techniques in which a single continuous independent 
variable is investigated and where values of chat independent variable 
are determined formally as a function both of the preceding values and 
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the responses that were obtained when they were administered* A technique 
due to Robbins and Monro (1951) is an example* Its purpose is to find 
that value of the independent variable* say such that the expected 
value of the dependent variable given B is equal to some predetermined 
constant * 

Our research investigates two examples of the Robbins-Monro 
process and three variant procedures which were motivated by it* Much 
of the previous research in this area has bei^n focused on asymptotic 
properties* Chernoff (1975) gives a brief anti readable review of this 
work* Of particular interest here is a paper by Hodges and T.ehmann 
(1956) because it suggests assuming a linear relationship between the 
independent and dependent variables and also assumes that the slope 
parameter is known* While these two conditions would seldom be met in 
practice, their theoretical and numerical results provide a basis of 
comparison for empirical findings* 

The Robbins-Monro procedure has been modified by some researchers 
so that two values of the independent variable are employed at each 
step (e*g, see Venter (1967)), This procedure has certain advantages, 
but only the case in which a single value of the independent variable 
is used at each step is studied here* 

Presently, we know of no application of Robbins-Monro procedures 
in an educational experiment. However, the technique has been applied 
to a measurement problem by Lord (1971a, 1971b)* Those two papers 
dealt with quantal responses, a subject not dealt with here* (For 
this reason and because we did not want to define the values of the 
independent variable a^ priori we have not considered the "Up and Down" 
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method of stochastic approximation^) The present area of investigation 
has aimilarities with sequential estimation^ but also aome important 
differences^ For the estimation problem only the "stopping rule" 
need be considered > for no independent variable is manipulated^ 
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The Problem 

Asaume that the experimenter* a Roal la that the valuft o^ a 
particular population mean Is to be changed from Ita present value* 
&t to a different value* a* For example* a population of adulta may on 
the average acore 6 " 100 on a particular atandardlzed reading teat 
and the goal la to Increaae that average to a - 116 » The experimenter 
has In mind a treatment variable (aay* number of houra of Individual 
tutoring) which he knowa can affect the average reading acore* but the 
exact nature of the relationship between reading acore and tutoring Is 
unknown. In other worda* the **end** la known* but not the specific 
**means*** and therefore* the appropriate value of the Independent variable* 
or treatment condition* muat be found* More formally* the expected 
value of the reading score la a function of the Independent variable* 
E(y) * f(x)* and the experimenter wlshea to determine that apeclflc value 
of the Independent variable* x = 6* for which E(y) " ot* or E(y(x <• 9)) ^ ot» 
For present purposes It la assumed that If x >0 then E(y(x)) > ot* and If 
X < 9 then E(y(x)) < ot- Given this altuatlon the experimenter can select 
an Initial value x^ and thereafter choose the value of the Independent 

variable as x . - = x - a (y^(x ) - ot)» The a .are aelected to have 
nTxnnTin n 

several characterlstlca* the most Intuitively Important of which Is that 

a -^0 as n— "at a suitable rate"* One poaalble definition la a = i» 
n ^ n n 

If appropriate a are chosen* auch as -* Robblns and Monro (1951) proved 
n n 

n-^w* x^— The experimenter* of course* must have some feel for the 
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speed of convergence^ and how this convergence is affected by the 
choice of the relationship between E(y(x)) and x» and the density 

of y(x)* lie also must have some idea of when to stop the experimentation* 
Most of the results in the literature to date, however, are asymptotic 
in nature, with relatively little work being done on stopping rules 
(Chemoff (1975) offers no citations, but see Farrell (1962))* The 
literature, as it appears to us, provides little if any practical 
guidance for the experimenter* 
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Methods 

Initial results were obtained with an interactive empirical approach 
using computer simulation techniques on a time'^ahared CDC Cyber 74* 
Many computer runs were made as the researchers sought to understand 
the importance of the numerous parameters which can be considered* Following 
this first phase of computer runs, during which all the values produced 
from a single sequential experiment were often observed, more traditional 
Monte Carlo experiments were performed, replicating the experiments a 
number of times to obtain esti^nates of how the procedures operate 
"in the long run'*- In summary, the approach used combined both an inter- 
active search during which the researchers observed the behavior of 
various functional relationships during a single replication and more 
traditional "fixed" type of experiments in which a number of replications 
of an experimental situation were made to obtain stable estimators^ 

All pseudo random numbers were obtained from either NORMAL or 
RAN3F which are a normal (N) random number generator and a uniform (U) 
random number generator, respectively* One thousand random numbers 
were generated per each call of these routines and following generation 
they were immediately permuted by an independent randomization procedure 
using the program PERMUTE- All routines are maintained by the 
University of Minnesota Computer Center- 
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Design 

The model for the random variable y wao y " U + where 

y *x 

^ - E(y(x)) - f(x) - 6qX^ + Pj^x^ + e^x^ + SjX^ and where e la 

2 2 

Independently identically diatributed either aa U(0^o ) or U(0,a )• 

y * X y * X 

Following the interactive aearch in which many parametric specif icationa 
and atopping rules were atudied* certain choicea of parametera and 
rulea were made for the more atandard type of Monte Carlo inveatigation* 
These included: 

1 1 1 a^ 

1» Four definitions of a » They were a ■ ^ tt* ~* tT"* where 

^ ^ ^^e ne 

6g is the first derivative of f(x) evaluated at 6, 6 ia the uaual alope 

n 1 

estimator* and s " |2 2 | , k « INTla/ijc]* where c >0 and even* 

1 » J ^ 

J » max(l» n " c + 1) and z ■= 1 if y(x ) < a, or z - -1 if y(x ) > a» 

n n n n 

(INT meana "integer part of»") For the procedure employing 6» 

1 1 8^ 

a = " for n < 20 and — otherwiae* In the definition a ■ — 
n n ^ n n 

n6 

a "finite memory" ia introduced into the approximation proceaa* and 
successively poaitive or negative valuea of " ^ cauae larger 

adjustments x . ^ than is the case with the other definitions* Both 
n X 1 

k 

a and 6 are random variables and this results iri ^ variant of the 
Robbins-Monro procedure in that it assumes the a^ to be "a fixed sequence 



of positive constants/' 
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2» Two stopping rules > They were 
Rl: Stop If n > 20 **nd If a contained In g + o I - +^-2-1 — DJ — 

(where ^ - 6 + 6x^) or n ■ 200» 

R2: Stop If n _> 20 and_t considering the last 20 values of z» If 

i:z * 9> 10> or 11> and the number of "runs" Is 9> 10, 11, 12, or 13» or 

If n - 200* 

3* Three sets of Bq> , Qy They were [100> •14142, 0» 0] 

[100, •34641. 0. 01, and [100, ,12686, ,0058512, 000023767J , 

2 

4, Two conditional variances . They were o - 100 and 25, 

y *x 

Most "final" experiments were based on 500 replications,^ Based on these 
replications, the mean and variance were computed for (^^^ ~ ^) 

n « 30, 50, 100 steps and for both rules, Rl and R2, Additionally, for 
both rules the mean and variance of the number of steps needed to stop 
were also computed, 

a^ ■> ^ was Included In the experiment because It was suggested In 

Robblns and >fonro's original paper, Hodges and Lehmann provide results 

on a " -4— when the regression is In fact linear, and It has certain 
n nPj^ 

optimal characteristics and therefore was Included as a basis for 
comparisons. In discussing the preceding work, Chemoff (1975) remarked 

that "In the stochastic approximation case using sequences a *■ there 

n n 

Is no prior knowledge of 6 to Insure that c » B ^, However* as data 
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accumulate one would hopefully obtain a satisfactory eetlmat** of E 
providing the successive are not too close to each other (p- ?0) 

We interpreted these comments to mean that when one has "sufficient" 
infon&ation one would estimate using the lesst squares estimator* 



„2 



3- Ir,itial results demonstrated that the instability of 6 for small n 
caused erratic adjustments and poor convergence. This lead to the 

1 Is 

procedure a * - for n - 1 19 and — r thereafter. The a ■ ~ 

n n ^ n n 

n6 

procedure was developed during the interactive part of the present research. 

It seemed reasonable to specify an adjustment procedure which would make 

larger adjustments if E(y (x )) - a were judged to be l*irge* Considering 

n n 

only the sign of y (x ) - a and taking c ■ A» for the patterns (+ + + +) or 

n n 

( )» ' 16» for patterns like (+-++) or ( +) s'^ - 2 , 

and for patterns with two pluses and two minuses* s ■ 1, This type of 
adjustment assumes that the error distributions are symmetric so that 

the probability of a plus at x ■ 9 is During the interactive phases 

n ^ 

of this research* c ■ 4 and c ■ 10 were found to work well. 

Stopping rule Rl employs the standard confidence interval for 
estimating u - This seemed a reasonable approach to consider* especially 

y ■ X 

when a * ^ is employed. The confidence coefficient* p, I'sed was ^60, This 

value was chosen during the interactive phase on the basis of performance. 
Stopping rule R2 comes from reasoning similar to that used In 

developing the s procedure. At x - e, for symmetric error distributions 

n 
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the fllgn of y^(x^) * ^ vould lod^pmdmtly dUtrlbutad m « a*rw>«Ul 
variable with parAn«ter Ri ^tteotUlly t«tt« tvo hrpcth^M** ow 
concerning **ran<loonc§ii'' and the other that th« propcrtloft of "plaMs* 



of t?.*^ (x^ - ^) , ar« reported for th* ccm<flclOTit %:udt*d «t 

^ 4i» r^<T tr^Ar. and vftrliinc« of the "nimb*r of ttrpt lo »CDp" {or 5U Aod 

2 

».v#TJijc# »qujir«* blAH, - la not reported, but It CAn b« 

n 

cai;,T ^>t4lr^^:i Vy ftqijArlng th* average bias and addliig thl« to th* 

2 2 

.tM^- r ^-f bi** ci,«. E(x - e)* - v(x - 9) + (E(x " e)) )■ 

n tt tt 

ti^tSoc *t:ploylnj: — w«» auf^rlor to the oCh*r metho<5a« but 5lnc« 

^ ; : ft<^UcMi kjric^* r«»ulc» a»»oc1aC^ vich vlll b* of greac*Bt 
a« '>#r-^r>awirffA"\ I: Is cI*Ar froo th* r*«*jlts that generally, 

7 r ir *■ a * ' th«* poorctc perfor^ttc*- In situations where 

r. n 

ri r.^ ir.f craat lot^ 1* available about the relationship betveea 

: \f t: .^p^^^n: ^*pv*iident variabl«a* th* r«itultii would lead us to 
V 

" " c 4. Thl» c^plcally do*A «a well as or better than 

o:^*r ^rocr^i'^re* not *^loyln(t 6^- It lo Dark*dly better when there 

1 w^^tV r^r 1 jir Icnfthlp Sf*tve*tt th* lnd*p*nd*nt and dependent variables 

A^.i \ po:^r utArt 1e sadr (ntt colicsnn I and 2 of Tables I-7)» In an 

k 

u:*"-^: tc d^t/^rtiin^ thr behavior of a • — vhen a "good start" Is 

n n 

-«v>, rxpcri::cr.:«fc reported In Table? 8 with ^(j^ * e were carried out* 

bt-Ilt^ve th<^ proct^ti'^re did rcanonably well under these clrcinDStances* 
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If t?ofc JtiforMtlon Is available, one might profitably chooae one of 

Che procedureB atudled. Neither Rl nor R2 is unifonnally better with 

respect to bias and ninaber of stepa to atop. There also appears to be 

at lesst aone interaction with the definition of a , and this complicates 

n 

natters in a feu instances. Here we can only recommend that one make a 
best guess about conditiooa and use that stopping rule which would be 
best . 
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Educational Significance 

One potential area of application for stochastic approximation 
l9 that of forraative evaluation. Stochastic approximation can suggest 
values of the independent variable which would attain programmatic 
goal9» and this infonoation could be fed to persons directly involved 
in program developiuent , Within the framework developed by Sanders and 
Cunningham (1974), stochastic approxiioation could provide ''external 
information" for "formative interim evaluation activities". When a 
suinmative evaluation is planned, perhaps using one of the more standard 
experimental designs* design points can be chosen in the region suggested 
through sequential experimentation* thereby increasing the likelihood 
that the program will demonstrate its effectiveness. 

In general* stochastic, approximation would appear to be a useful 
technique in any area where individuals have a goal firmly in mind but 
lack sufficient knowledge of the independent variable to design an 
efficient* more traditional experiment. Education is goal oriented* 
and information about how to achieve a goal is often more important than* 
say* information about the exact nature of the relationship between an 
independent and dependent variable. Stochastic approximation can provide 
useful information about an independent variable* even when its defined 
over a broad range of values* while requiring relatively few subjects 
for its Implementation, 
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Mean and Variance ol* the Bias (x^ - 6) at 30 Steps Where - 4 

^ ^D* ^1 ' ^2' ^3 ^ 

[100,. 14142, 0,0] [100,. 34641, 0,0] [100, .12686, . 0058512, 

-.000023767] 



a c~N(0,o^ ) c~U(0,o^ ) c~N(0,c^ ) c~U(0,c^ ) c~N(0,o^ ) £--0(0,0^ ) 

n y.x y.x y.x y.x y.x y.x y,x 



100 

1 

25 


-.49 
160.93 


.38 
177.75 


-.13 
27.13 


.20 
29.84 


-.96 
12.85 


-.79 
14.54 


-.19 
40.85 


.24 
44.77 


-.08 
6.81 


.10 
7.46 


-.53 
3.39 


-.48 
3.81 


100 

1 


-61.16 
72.00 


-61.11 
81.11 


-9.73 
27.65 


-9.25 
32.02 


-6.57 
20.82 


-6.68 
22.91 


n 

25 


-61.27 
18.89 


-60.96 
20.48 


-9.46 
7.69 


-9.62 
7.62 


-6.48 
4.74 


-6.36 
5.59 


100 

J- 


-44.86 
1436.76 


-41.86 
1385.58 


-5.65 
140.41 


-4.55 
180.92 


-3.14 
108.84 


-2.36 
188.85 


■ n$ 

25 


-36.23 
490.86 


-35.41 
577.45 


-5.72 
65.93 


-5.57 
51.08 


-3.07 
43.88 


-3.10 
50.68 


100 

k 

^Cc^4) 

25 


-1.92 
298.62 


-3.58 
452.01 


.42 
72.73 


.02 
97.26 


-.18 
44.55 


-.19 
61.85 


-.88 
71.44 ' 


-.98 
96.15 


.44 
18.46 


.19 
22.93 


.18 
10.77 


-.32 
14.73 


100 

k 

^(c=10) 

25 


-10.85 
835.47 


-17.03 
764.57 


-.81 
110.47 


-1.93 
87.05 


-.06 
47.69 


-.89 
49.23 


.37 
378.17 


-1.98 
419.80 


-.67 
24.05 


-.75 
25.86 


-.10 
24.08 


.26 
11.04 



For Tables l*-8 the upper number in each cell is the mean and the lower number 
is the variance. 
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Table 2 



Mean and Variance of the Bias (x - 9) at 50 Stepc Where x » 4 

n 1 



^^D* ^1* ^2* ^3 ^ 

ll'oo,. 14142, 0,0] [100,. 34641, 0,01 [100, . 12686, . 0058512, 

-.000023767] 



2 

a a 

ti y • A 


E~N(0,a^ ) 
y.x 


E~U(0,a^ ) 
y.x 


e~K(0,a^ ) 
y.x 


e^U(0,a^ ) e~K(0,a^ ) e-vU(0,a^ ) 
y.x y.x y.x 


100 
25 


.30 
93.84 


.34 
109.69 


.17 
15. 75 


.16 
18.35 


-.43 
7.21 


-.58 
8.67 


.18 
23.66 


.20 
27.54 


.08 
3.94 


.08 
4.59 


-.28 
1.96 


^.25 
2.25 


100 

1 

n 

25 


-56.87 
62.61 


-56.83 
69.82 


-8.02 
20.59 


-7. 69 
23.88 


-5.04 
13.69 


-5.17 
15.49 


-56.92 
16.49 


-56.61 
17.82 


-7.92 
5.44 


5.88 


—A OH 

3.12 


3.67 


100 

1 


-20.43 
1036.14 


-22.29 
994.74 


-1.38 
158.51 


—1 n 
± • j± 

104.35 


33.50 


- 67 
67.36 


n6 

25 


-20.56 
231.29 


-20.91 
236.72 


-2.97 
25.52 


■ -3.20 
18.06 


-1.47 
12.84 


-1.43 
13.58 


100 

k 

25 


-1.48 
157.02 


-1.99 
262.19 


.07 
39.42 


-.06 
50.39 


.26 
25.33 


-.34 
33.99 


-.46 
40,04 


-.47 
58.47 


.27 
9.83 


.11 
13.56 


.04 
6.11 


.07 
8.22 


100 
5-(c:=10) 

25 


-7.93 
476.52 


-12.07 
513,41 


-.38 
54.41 


-1.36 
46.98 


-.12 
32.12 


-.31 
22.28 


.33 
169.92 


-1.81 

229,20 


-.10 
12.92 


-.02 
12.72 

■ 


.20 
6.35 


.16 
6.72- 
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Table 3 



Mean and Variance of the Bias (x - 9) at 100 Steps Where x - 4 

n -L 



llOO,. 14142, 0,0] (100,. 34641, 0,0] [100, . 12686, . 0058512, 

-.000023767] 



^^^<°'Vx> ^^"■<f''Vx> ^^«<°'V-^ ^-'«(°'%.x> -"<°'Vx> 



100 
25 


.35 
48.75 


.00 
58.39 


.16 
8.14 


.01 
9.75 


-.16 
3.56 


-.27 
4.65 


.19 

12.20 


.01 
14.63 


.08 
2.03 


.00 
2.44 


-.11 
.95 


-.16 
1.08 


100 

1 


-51.56 
53.31 


-51.46 
57.95 


-6.31 
13.19 


-6.05 
15.68 


-3.53 
7.21 


-3.63 
8.42 


n 

25 


-51.56 
13.64 


-51.36 
14.56 


-6.20 
3.50 


-6.28 
3.83 


-3.48 
1.71 


-3.42 
2.07 


100 

1 

n6 

25 


-8.62 
333.15 


-9.93 
308.16 


-.43 
44.44 


-.40 
34.35 


-.16 
8.90 


-,31 
18.12 


-10.44 
74.54 


-10.67 
71.06 


-1.39 
7.19 


-1.53 
5.60 


-.50 
3.08 


-.58 
3.30 


100 

k 

f-(c=4) 
n 

25 


-.28 

7iB.34 


-1.03 
115.32 


.25 
21,10 


.15 
27.90 


.09 
U.89 


.02 
15.02 


-.11 
19.31 


-.27 
28.79 


.05 
5.08 


-.04 
6.84 


-.05 
3,10 


.02 
4.06 


100 

|-(c=10) 
n 

25 


-5.75 
227.50 


-7.97 
299.75 


-.35 
19.40 


-.61 
35.03 


.04 
11.50 


-.29 
14.37 


-.26 
71.40 


-1.61 
113.45 


.00 
5.18 


-.06 
8.52 


.12 
2.98 


-.01 
3.15 
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Table 4 

Mean and Variance of the Blaa (X - 9) When 

n 

Stopped with Parametric Rule (Rl) Where x " 4 



16q» 

[100,. 14142, 0,0] [100,. 34641, 0,0] [100, . 12686, . 0058512, 

-.000023767] 



a 0^ E>vN{0,o^ ) e>vUCO,o^ ) e-^il(0,o^ ) e-^V(0,o^ ) e-NCO,o^ ) g-'UCO.o^ ) 

n y.x y.x ^ * y.x y.x ^ * y.x ^ * y.x * y.x 



100 

1 


-.70 
237.97 


.66 
265.39 


-.17 
40.34 


.33 
44.80 


-1.07 
18.41 


-1.09 
21.33 


25 


-.25 
60.46 


.40 
67.14 


-.10 
10.08 


.16 
11.18 


-.49 
4.75 


-.55 
5.50 


100 

1 


-47.45 

* 

61.09 


-46.62 

* 

49.33 


-7.82 
23.91 


-7.49 
24.05 


-4.42 
13.57 


-4.54 
14.73 


n 

25 


-46.58 

* 

11.45 


-46.76 
12.53 


-4.94 
2.87 


-5.04 

* 

2.70 


-2.60 
1.38 


-2.54 
1.26 


100 

1 


-14.39 
924.61 


-12.61 
1000.61 


-5.28 
78.38 


-5.11 
96.76 


-2.70 
44.00 


-2.56 
47.93 


n6 

25 


-5.16 
112.84 


-5.46 
71.87 


-2.04 
13.92 


-1.92 
12.36 


-.68 
5.93 


-.74 
3.91 


100 

k 

25 


-2.36 
352.92 


-4.32 
460.81 


.06 
59.17 


.41 
67.44 


-.80 
28.71 


-1.15 
32.94 


-.89 
91.96 


-1.20 
110.92 . 


.10 
14.93 


.22 
15.90 


-.32 
7.28 


-.65 
7.61 


100 

. k 

^(c=10) 

25 


-13.25 
498.27 


-14.75 
502.03 


-1.91 
77.19 


-2.41 
69.56 


-.42 
32.00 


-.71 
33.87 


-1.88 
129.16 


-1.79 
114.31 


-.48 
14.53 


-.64 
17.57 


.42 
8.27 


.39 
8.20 



* 

The eatlmates in these cells are baaed on 100 repllcatlona Inatead of 500. 
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Table 5 

Mean and Variance of the Number of Stepa 
When Stopped with Parametric Rule (Rl) Where x - A 



[6q> ^2* ^3^ 



[100, .14142,0,0] 



[100, .34641,0,0] 



y.x 



y.x 



^ * y.x 



c-'N(0,a; ) 

y.x 



y.x 



[100, .12686, .0058512, 
-.000023767] 

E'-N(0,a^ ) £^UCO,a^ ) 
^ ' y.x' y.x' 



100 

25 


20.18 
2.37 


20.21 
1.79 


20.13 
1.30 


20.18 
1.54 


23.13 
338.95 


22.23 
194.61 


20.17 
2.07 


20.13 
1.08 


20.18 
2.33 


20.14 
1.09 


26.28 
622.57 


24.96 
464.60 


100 

1 


196.44 

it 

627.30 


198.24 

it 

309.76 


87.64 
7087.82 


85.30 
7003.51 


92.26 
7320.44 


95.61 
7372.14 


n 

25 


200.00 

it 

0.00 


200.00 
0.00 


191.49 
1393.06 


196.05 
572.69 


191.22 
1416.44 


194.62 

it 

622.76 


100 

1 


89.66 
5019.12 


93.18 
5523.06 


28.76 
788.86 


30.11 
1132.37 


28.78 
695.83 


29.03 
716.53 


■ ne 

25 


177.87 
2849.49 


178.80 
2840.74 


76.85 
2214.93 


82.71 
2414.49 


78.21 
1589.28 


80.39 

* 

1468.92 


100 

k 

25 


24.86 
338.35 


27.53 
610.14 


25.68 
. 210.89 


26.46 
262.41 


26.02 
165.28 


27.16 
228.26 


25.03 
477.47 


27.37 
711.50 


25.50 
155.27 


26.75 
213.57 


25.87 
137.34 


28.97 
405.82 


100 

k 

^(c=10) i 
25 


53.20 
3807.48 


65.79 
5113.46 


24.32 
399.95 


25.61 
492.67 


23.96 
250.35 


26.59 
654.13 


83.42 
6015.15 


111.00 
6715.59 


27.24 
775.31 


29.36 
1136.49 


27.01 
777.34 


26.12 
646.42 



The estlmatea In these cells are baaed on 100 replications Instead of 500. 
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Table 6 

Mean and Variance of the Bias (x^ - 6) When 
Stopped with Nonparametric Rule (R2) Where x. - A 



[100,. 14142, 0,0] UOO,. 34641, 0,0] [100,. 12686, .0058512, 

-.000023767] 



a E~N(0,a''' ) E:-U(0,a^ )* E:~N(0,a^ ) E:~U(0,a^ ) E~N(0,a^ ) E:.^U(0,a^ ) 

n y.x * y.x ^ * y.x * y.x * y.x * y.x * y.x' 



100 

1 

25 


-.21 
173.52 


.05 
179.81 


-.01 
29.40 


.07 
29.87 


-.94 
12.59 


-.80 
14.97 


.00 
44.00 


.08 
44.88 


.00 
7.34 


.03 
7.48 


-.44 
3.42 


-.54 
4.09 


100 

1 
n 

25 


-48.05 
42.17 


-50.04 
51.09 


-7.75 
16.73 


-8*02 
25.63 


-4.68 
11.06 


-5.52 
17.34 


-46.74 
11.18 


-46.54 
12.08 


-6.17 
3.10 


-7.01 
4.97 


-3.66 
1.75 


-4.10 
2.90 


100 

1 


-9.77 
526.20 


-14.57 
631.61 


-2.86 
54.60 


-3.25 
84.38 


-1.55 
18.48 


-2.16 
30.35 




-9.70 
56.80 


-11.74 
82.45 


-2.53 
8.40 


-3.42 
11.26 


-1.48 
4.10 


-1.83 
5.39 


100 

k 

f-Cc=4) 

25 


-.46 
24fl.88 


-2.30 
453.42 


.53 
77.44 


-.20 
106.10 


-.47 
46.65 


-.60 
65.27 


-.04 
61.75 


-.50 
92.97 


.49 
16.49 


.07 
25.41 


.12 
10.77 


-.11 
14.87 


100 

k 

— (c=10) 
n 

25 


-8.11 
391.91 


-12.36 
502.21 


-.34 
42.68 


-1.73 
64.64 


.29 
30.43 


-.25 
33.71 


.49 
138.40 


-1.48 
215.96 


.00 
10.91 


-.12 
16.19 


.61 
6.55 


.52 
7.37 



23 

ERIC 



Table 7 

Mean and Variance of the Number of Steps 
When Stopped with Nonparametrlc Rule (R2) Where x, ■ A 



^^0*^1*^2*^3^ 

[100,. 14142, 0,0] [100,. 34641, 0,0] [100, . 12686 ,. 0058512, 

-.000023767] 



n y* 



100 

1 

25 


32.42 
226.32 


31.79 
187.77 


32.40 
223.18 


31.86 
187.39 


35.06 
294.07 


33.45 
247.42 


32.60 
224.71 


31.98 
187.41 


32.60 
224.71 


31.98 
187.41 


34.81 
240.51 


33.31 
237.54 


100 

1 
n 

25 


173.71 
2234.70 


136.65 
3301.21 


61.13 
1369.02 


50.38 
917.82 


60.90 
1359.13 


48.90 
756.51 


200.00 
0.00 


199.66 
34.43 


112.97 
2832.98 


84.67 
1962.52 


101.78 
2279.99 


79.81 
1652.54 


100 

1 

n6 

25 


84.30 
1188.04 


70.84 
999.99 


51.21 
1039.26 


43.98 
681.22 


47.11 
596.34 


44.06 
642.90 


110.54 
1751.84 


94.07 
1258.61 


66.81 
718.70 


* 57.02 
614.92 


59.28 
536.85 


53.61 
471.00 


100 

k 

— (c=4) 
n 

25 


39.48 
365.17 


36.76 
341.61 


31.71 
203.34 


30.31 
156.66 


30.70 
191.41 


30.02 
172.76 


36.85 
239.20 


36.51 
297.97 


35.16 
310.12 


31.93 
171.47 


31.08 
140.91 


30.98 
162.65 


100 

k 

^Cc=10) 

25 


58.92 
994.45 


54.05 
745.88 


39.62 
431.32 


36.75 
358.61 


35.52 
307.83 


35.71 
340.59 


64.06 
1192.78 


59.23 
953.26 


39.79 
407.40 


37.49 
324.22 


37.07 
364.19 


34.87 
315.87 



ERIC 
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Table 8 



Means and Variances Where x.-e and e-N(0,o -100) 







Bias (x -6) 
n 


Bias Cx^~S) 


Bias (x -0) 
n 


Bias C^jj-S) 


No. of steps 


Bias 


No. of steps 


[6q* ^2* ^3^ 


a 

n 


at 30 steps 


at 50 steps 


at 100 steps 


when stopped 
with Rl 


when stopped 
with Rl 


when stopped 
with R2 


when stopped 
with R2 




1 


-.49 


.30 


.35 


-.88 


20.33 


-.22 


32.59 


[100..14142»0»0] 




160.93 


93.84 


48.75 


235.51 


1.11 


172.67 


222.70 




k 


.30 


.10 


.39 


-.03 


23.82 


-.25 


33.11 
























234.71 


148.69 


77.78 


243.27 


80.88 


232.17 


289.16 




1 


-.13 


.17 


.16 


-.26 


20.30 


-.01 


32.57 


[100».34641»0.0] 




27.18 


15.75 


8.14 


39.86 


1.07 


29.24 


219.56 






.25 


.17 


.08 


-.06 


25.45 


.66 


30.56 
























72.55 


36.14 


19.10 


63.29 


176.93 


77.57 


'203.33 



26 



9^25 



References 



Chernoff, H. Approaches In sequential design of experiments. 
In J. N. Srlvastava (Ed.)> A survey of statistical design 
and linear models . Amsterdam: North-Holland Publishing, 1975. 

Farrell» R. H. Bounded length confidence Intervals for the zero of 
a regression function. Annals of Mathematical Statistics , 
1962, 33, 237-247. 

Ilerzberg» A. M. & Cox, D. R. Recent work on the design of experiments: 
A bibliography and a review. Journal of the Royal Statistical 
Society , 1969, Series A, 132 , 29-67. 

Hodges, J. L. & Lehinann, £. L. Two approximations to the Robblns-Mbnro 
process. In J. Neyman (£d.)» Proceedings of the Third Berkley 
Symposium on Mgf>>'^ftMcal Statistics and Probability . Berke ley , 
California: University of California Press, 1956. 

Lord, F. M. Robblns-Monro procedures for tailored testing. Educational 
and Psychological Measurement , 1971, 3-31. 

Lord, F. M. Tailored testing. An application of stochastic approximation. 
Journal of American Statistical Association , 1971, 707-711. 

Meyer, D. L. Response surface methodology In education and psychology. 
The Journal of Experimental Education , 1963, 31, 329-336. 

Robbins, H. 6 Monro, S. A stochastic approximation method. Annals 
of Mathematical Statistics , 1951, ^^.^ 400-407. 

Sanders, J. R. 6 Cunningham, D. J. Formative evaluation: Selecting 
techniques and procedures. In 6. D. Borlch (Ed.), Eyaluatlng 
educational programs and products . Engleijood Cliff, New Jersey, 
Educational Technology Publications, 1974. 

Venter, J. H. An extension of the Robbins-^Monro procedure. Annals 
of Mathematical Statistics , 1967, 38, 181-190. 

Wetherlll, G. B. Sequential methods In statistics . IiOndon: Chapman 
and Hall, 1975. 



27 



Footnotea 

^The original plan was to have 500 replicationa for each aet of 

condltlona> however, given the value of uaed here, a ■ - converged 

L n n 

alowly and for aome conditiona the rule "atop if n ■ 200" waa uaed 

for virtually every replication. We decided to uae only 100 replicationa 

in theae inatancea, and thoae runa are noted in the tablea. 

2 

The "c" in thia quote ia not defined in the aame way aa the "c** 

k 

in the definition of a ■ — . 

n n 
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